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Abstract 

We consider the stability of robust scheduling policies for Lu-Kumar networks. 
These are open networks with arbitrary routing matrix and several disjoint 
groups of queues in which at most one queue can be served at a time in each 
group. The arrival and potential service processes and routing decisions at 
the queues are independent, stationary and ergodic. A scheduling policy is 
called robust if it does not depend on the arrival and service rates nor on 
the routing probabilities. A policy is called throughput- optimal if it makes 
the system stable whenever the parameters are such that the system can be 
stable. We propose two robust polices: longest-queue scheduling and a new 
policy called longest-dominating-queue scheduling. We show that longest- 
queue scheduling is throughput-optimal for two groups of two queues. We 
also prove the throughput optimality of longest-dominating-queue scheduling 
when the network topology is acyclic, for an arbitrary number of groups and 
queues. 
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Figure 1: Example of Lu-Kumar network 
1. Introduction 

We consider the scheduling of Lu-Kumar networks [T], [9]. These are queueing 
networks with disjoint groups of queues that cannot be scheduled simultaneously. 
Max Weight scheduling, proposed in [3], is known to be throughput optimal for these 
networks. However, Max Weight scheduling suffers from high complexity and also 
dependency on the knowledge of all of the service rates, queue lengths, and routing 
probabilities. A natural low complexity scheduling algorithm is longest-queue (LQ) 
scheduling, studied in [2], [7] and [IT], which we discuss in this paper in details. 

In general, we know that the utilization being less than one for each server is 
necessary but not sufficient for the stability of a queueing network. This condition 
specifies that work arrives at each server at rate less than one. In [JJ, Lu and Kumar 
provided an example of a network (Figure [I]) with priority scheduling that is unstable 
despite satisfying the utilization condition. To see this, assume that /ii > ^ and 
fJ-4 > 1&2 and that queue 3 is initially empty while queue 2 is not. Group 1 serves 
queue 2, so that queue 1 is not served and queue 3 remains empty. Eventually, queue 2 
becomes empty and queues 1 and 3 get served until queue 3 becomes empty (because 
P"\ > At that time, queues 4 and 2 get served, until queue 2 becomes empty 

(because [i± > (12)- Thus, queues 2 and 3 are never served together. Consequently, 
they form a virtual group and the system cannot be stable unless the utilization of 
that virtual group is less than one, which is an additional condition not implied by the 
original utilization condition. 

If priority is given to the last buffer in each station (queues 2 and 4), the network 
is stable. It is shown in [51 [S] that, for a re-entrant line, the last-buffcr-first-serve 
discipline with pre-emption is throughput optimal. 
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We analyze the stability of the queueing networks under robust policies using their 
fluid model. The fluid model converts a stochastic system into a deterministic system, 
based on the functional strong law of large numbers, [H [3 |H1 Under weak 

assumptions, the stability of the fluid model implies the stability of the queueing 
network. The common method for showing stability of the fluid model is to find a 
Lyapunov function for the differential equations of the system. A novel feature of 
this paper is that to prove the stability of the fluid system under LQ scheduling, we 
investigate the possible trajectories of the state and show that they can only go to 
zero, instead of using a direct Lyapunov function. 

There has been relatively little work on the stability of LQ scheduling in the liter- 
ature. We can mainly mention the following papers. In 10J, Kumar et al. consider 
sufficient conditions for stability of stable marriage scheduling algorithms in input- 
queued switches. In Dimakis and Walrand identify new sufficient conditions 
for longest-queue-first (LQF) scheduling to be throughput optimal. They combine 
properties of diffusion-scaled path functionals and local fluid limits into a sharper 
characterization of stability. See also [13] for a variation on the first order sufficient 
condition of that paper (resource pooling). Recently, in [14 , Baharian and Tezcan 
consider LQF scheduling for parallel server systems. It is shown that the nominal 
traffic condition is sufficient to prove stability if the underlying graph of the parallel 
server system is a tree. Furthermore, additional drift conditions are provided for the 
stability of a special parallel server system known as X-model. The network model 
that we consider is different from all the previous work on LQ scheduling. 

In addition to LQ scheduling, we propose a new scheduling policy called longest- 
dominating-queue (LDQ). This policy is closely related to LQ scheduling. According 
to this policy, none of the queues that feed a larger maximum-length queue of another 
group is served. Among those queues that are not dominated by a maximum-length 
queue of another group, the longest one is scheduled. We use the fluid model and show 
that the maximum of the queue lengths is a Lyapunov function to prove the stability 
of LDQ scheduling in a general network which is an acyclic graph. 

We use boldface lower case letters v to denote vectors and boldface capital letters M 
to denote matrices. [,] T denotes matrix transposition operation and [-]~ T the matrix 
inversion and transposition. Let V and W be matrices of size L x N, then V -< W 
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means i>jj < u>y, for i = 1, . . . , L and j = 1, . . . , N. Also, 1^ and 0^ stand for column 
vectors of l's and O's with length L, respectively and Olxn stands for the Lx N matrix 
of all entries. The indicator function of set A is shown as 1a- 

The rest of the paper is organized as follows. In Section [2] we provide the precise 
network model and problem formulation, and state the main results of the paper. In 
Section [3j we focus on the LQ scheduling and prove that it is throughput optimal 
for Lu-Kumar networks with two groups of two queues. We also provide sufficient 
conditions for the stability of LQ scheduling for Lu-Kumar networks. In Section |1J we 
propose the LDQ scheduling and prove that this new policy is stable if the network 
topology is acyclic. We provide simulation results and examples which show that when 
there is a cycle in the network, LDQ may not be stable. 

2. Problem definition and system model 

2.1. Network model 

We consider a network with K queues and a routing matrix Hkxk- The entry nj 
is the probability that a job goes to queue j upon leaving queue i . Therefore, a job 
leaves the network upon leaving queue i with probability 1 — J2j r ij ■ I n each queue, 
jobs are served in their order of arrival. 

The random length of queue i at time t > is Xi (t) , the vector of service rates of 
the queues is fi = [ni,fi2, ■ ■ ■ , Hk] T , and the vector of arrival rates to the queues is 
A = [Ai, A2, . . • , \r] T ■ The arrival processes to the queues are independent stationary 
ergodic processes. In this network, not all the queues can be served at the same time. 
The queues are partitioned into J disjoint groups {Gj}j—x and only one queue can be 
served in each group at a time. Let Kj = \Gj\, so that K\ + K2 + ■ ■ • + Kj = K. We 
call such networks Lu-Kumar networks because they were analyzed by Lu and Kumar 
in pp. Figure [2] illustrates such a network with 2 groups of two queues: Qi = {1,2} 
and G 2 = {3,4}. 

We assume the network is open, i.e., all the jobs eventually leave the network. Since 
the network is open, 



Q = I + R T + (R T ) 2 + ■•• = (!- Pjy 1 
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is a finite positive matrix. So, the matrix (I — R T ) is invertible. 

The service disciplines that we consider are nonpreemptive and independent of A, fi 
and R. The goal is to analyze the stability of this network when the traffic conditions 
stated in Section |2.2| hold. We use the fluid model to analyze the stability of the 
network. The fluid model is described by a set of ordinary differential equations. Let 
Xi{t) be the length of queue i at time t and Ti(t) be the random total amount of time 
that queue i has been scheduled up to time t. Let also Xi(t) = lim^oo Xi(rt)/r and 
Ti(t) = lim r _ i . 00 Ti(rt)/r. Then the fluid model equations are 

K 

X&) = x,(o) + Xjt - ^(t) + ]T n^iTiit), j = 1, . . . ,k. (i) 

The fluid model is stable if there exits some 5 > such that, for each fluid solution 
with |X(0)| < 1, one has |X(i)| = for t > S. Under weak conditions, the stability of 
the fluid model implies the stability of the queueing network (e.g., the Harris recurrence 
of a Markov model in the case of renewal arrival processes, i.i.d. service times and 
Markov routing). See [9] for a discussion of such results. 

To investigate the possible trajectories of the differential equations, we define the 
state S(t) of the network at time t > to be the set of queues with maximum queue 
length in each group at that time. More precisely, if Sj is the set of maxima in group j, 
for j = 1, . . . , J, the state of the network is S = (Si, S2, ■ ■ ■ , Sj). Since Sj is a subset 
of Qj ={1,2,..., Kj}, there are Yij=i 2 Kj — 2 K possible states of the network. Note 
that the state of a group is the empty set if all the queues in that group are empty. A 
state (Si, S2, . . . , Sj) is said to be feasible if S(t) can spend a positive amount of time 
in that state. Later we see that following the trajectory of the state S(t) is the key 
idea to prove the stability of LQ scheduling in Lu-Kumar networks. 

The main contributions of this paper are the following theorems. 

Theorem 2.1. The Lu-Kumar network in Figure^ with two groups of two queues, is 
stable under LQ scheduling if the utilization conditions hold. 

Theorem 2.2. A Lu-Kumar networks is stable under LDQ scheduling if the utilization 
conditions hold and there is no cycle in the topology of the network. 

The stability of Lu-Kumar networks with more than two groups of two queues under 
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Figure 2: Lu-Kumar network with two groups of two queues 

LQ scheduling is still an open question. Examples show that a Lu-Kumar network may 
not be stable under LDQ scheduling if its topology is not acyclic. 

2.2. Stability condition 

Define the drift matrix D of the network by 

D = M(R-I), (2) 

where M = diag{/i}. Since Q :— (I — R T ) _1 is a positive matrix, one has 

T> T = M 1 Q^0 KxK . (3) 

Furthermore, let the vector of nominal traffic of the queues be v — \u\, v^, ■ • - , vk] T ■ 
We have 

K 

v% = A, + y^JjjVj- 

3=1 

In matrix form. 



I / = (I-R i )" 1 A 



(4) 



By Proposition 2.5.3. in [5], the necessary stability conditions of the network are 



£-<!' Vj = l,...J. 



(5) 



These are the utilization conditions. They express that work for each group arrives at 
the network at rate less than one. 

Using Equations ([2| and Q, we find an equivalent stability conditions which is 
that ejD~ T A + 1 > for all j — 1, . . . , J, where ej is a column vector of length K 
corresponding to group j such that component i of §j is e.j(i) — l^g^. 
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3. LQ scheduling 

3.1. General network 

In this section, we prove a lemma that will be useful in the proofs for the stability 
of LQ and LDQ scheduling. We also provide sufficient conditions for the stability of 
general networks under LQ scheduling. Under this discipline, the longest queue in 
each group is served. To break ties, we can use a static priority scheduling among the 
maximum queues, or serve any of the maximum-length queues randomly. 

We use the fluid model to prove the stability of LQ scheduling as stated in Equation 
([I]). Further conditions for LQ scheduling are that the server in each group spends all 
its time serving the longest queues. That is, if Sj is the set of non-empty queues with 
maximum length in group C?j, then 

E £(t) = 0. (6) 

i&Gj\Sj 

A regular point is a value of t € [0, oo) at which the function 

/ : [0, oo) -> R J , f(t) = [max{Xi} ieSl , . . . , max{X;} ieg/ ] T 

i i 

is differentiable in all of its components. Therefore, in a regular point St remains 
constant in [t, t + e] for some e > 0. By S t we indicate the value of S at time t > 0. 

Let Sj be the set of queues with maximum length in group j and \Sj\ — Lj . Define 
S = UjSj and \S\ = L = Y^j-^j- The corresponding drift matrix and arrival vectors 
to set S are D L = [dk^kes and A L = [A,] ie s. Also, let f(t) = a = [ai, . . . , aj] T be 
the drifts of maximum length queues in the J groups. 

A sketch of the proof for stability of LQ scheduling in Lu-Kumar networks with two 
groups of two queues is the following. The drifts of queues with maximum length in 



one group are equal at a regular point by Lemma 3.1 In Lemma 3.3 we show that 
f(t) is strictly negative in at least one of its components, at a regular point. More 
precisely, if t is a regular point, f(t) has a component i determined by St such that 
fi{t) < —e(St) for some e(St) > if |X(f)| > 0. So St cannot remain constant as t — > oo 
unless X(t) = 0, but this is not enough to prove stability, as St can in principle travel 
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around different states forever. We will show that there is no loop in the trajectory of 
St, and this will establish the result. 

Note that St goes from one state to another when a new queue appears in the 
set of maxima in one group. Indeed, state S is feasible if time-sharing can keep the 
queue-lengths of set of maxima equal in that state, so that a queue cannot disappear 
from the set of maxima. Later we see that S is feasible if its corresponding vector of 
time-sharing T obtained from Equation ([9| below is a non-negative vector. 

We define two possible moves for St in the state diagram of the network. 

1. Increase: A new maximum appears in one of the groups and St reaches a feasible 
state. 

2. Jump: A new maximum appears in one of the groups and St visits an infeasible 
state but immediately goes to another feasible state. 

To clarify the two possible moves, we consider an example of the network in Figure 
[l] Suppose that St is initially in state (1,4) and that, after some time, X2 becomes 
equal to X\. At this time, queues 1 and 2 remain equal by time-sharing if the following 
identity holds: 

A - fjtttt = m - /i 2 (l - Ti); 

or, equivalently, if 

• A + fi 2 - M4 
Jl = 1 ■ 

This identity can hold if the expression for T\ is in [0,1], i.e., if A + H2 > and 
A < /ii +/14. The latter inequality certainly holds because of the utilization conditions. 

Thus, if A + fi2 > A*4, there is an increase move in which St goes from state (1,4) 
to the feasible state (1, 2, 4). On the other hand, if A + /i 2 < H>4,, state S t jumps from 
state (1,4) to state (2,4), since (1,2,4) is infeasible. Below, we will show these two 
transitions as 

(1,4) -> (1,2,3) and (1,4) -> (1,2,4) -> (2,4), 

respectively, where (l,2,4)o indicates that (1,2,4) is not feasible. 

If S t reaches the state in which all the queues are empty, St remains in the absorbing 
"zero" state. Note that the zero state is always feasible by the utilization conditions. In 
this state, Ti — Vi/fii is acceptable by Equation ^ and leads to X, = 0, Vi, 1 < i < K. 
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Since the zero state is feasible, S t remains in this state for a positive amount of time. 
Now since no new maximum will appear in the network in the zero state, the fluid 
limit equations will not change, and St remains in this absorbing state forever. 

Lemma 3.1. At a regular point t, Xi(t) — Xj(t) if i and j are in the set of maxima 
of same group. 

Proof. Since i and j are in the same group and both in the set of maxima, Xi = Xj . 
Thus, if t is a regular point, Xi and Xj are differentiable and Xi(t) = Xj(t). 

Lemma 3.2. Consider one arbitrary queue i and assume that t is a regular point such 
that Xi{t) = 0. Let i>i n be the total arrival rate and u out be the departure rate of queue 
i at time t. Then Vi n = u out . 

Proof. Since t is regular and Xi(t) = 0, Xi is differentiable at t and Xi(t) = 0. This 
proves that = v out . 

Lemma 3.3. At a regular point, a cannot be a non-negative vector. 
Proof. Define matrix E^ x j as the following. 

E= [e 1 ,e 2 ,...,e J ] (7) 

where e^ is the column vector of length L defined as follows: 

By the fluid model equations ([T]) and Lemma 3.1 we have the following matrix 
equation: 



-(D L ) T E 
E T 



JxJ 





T 








a 




1j 



Solving Equation (|9| using the block inverse formula, we have 
a = (E T (D L )- T E)- 1 (E T (D L )- T A L + 1,) . 



(9) 



(10) 



A careful observation shows that E T (Di)~ T A£ + lj is a positive vector, by the 
stability condition of these subset of queues which is a weaker condition than the 
stability condition of the whole network. 
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In Section 2.2 we showed that D _T is a negative matrix. has the same properties 
as D so, E T (D^)~ T E is also a negative matrix. Now since E t (Dl)~ t Eo! is a positive 
vector, a cannot be a non-negative vector. 



Lemma |3.3| shows that some non-zero maxima must decrease, so that St cannot 
remain in any state but the zero state which is the only absorbing state. 

A sufficient condition for reaching the zero state is that all the possible states of the 
network are feasible. Indeed, the drifts of the maximum queues in a group are equal 
in a feasible state, so that a queue cannot disappear from the set of maxima before 
its group becomes empty. Therefore, S t visits a new state each time a new maximum 
appears, and it cannot make a loop. Consequently, after some finite time St reaches 
the zero state and stability is proved. 

In some networks, some states are not feasible. In such networks, proving that St 
does not loop requires a different argument. We show it for networks with two groups 
of two queues. 

3.2. Lu-Kumar network with two groups of two queues 

In this section, we prove Theorem |2.1| The method of proof is to investigate the 
possible paths of St in the state diagram to show that St cannot make a loop and 
necessarily reaches the zero state. 

The proof uses a few properties of the trajectory of St- We begin with the following 
result that says that if a queue is removed from the set of maxima, the remaining 
maxima in its group have a positive drift. 

Lemma 3.4. Suppose that S t switches from state S^ to S^. Let S A = \ 5* (2) - 
Then, if i G Sa, the maxima of the group that i belongs to have positive drift in state 

s&. 

Proof. If i G Sa, queue i is removed from the set of maxima after jumping to state 
S( 2 \ This requires that, in state S^- 2 \ queue i has a smaller drift than the other 
maxima in its group, say Gj- That is, Xi < Xfc,Vfc G S^ n Gj- But, since queue i 
is not served, one has X^ > 0. Consequently, the drift of the maxima in group j is 
positive. 

Also recall that a queue cannot disappear from the set of a maxima by a transition 
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out of a feasible state. 

We are now ready to prove the following result. 

Lemma 3.5. Under the stability conditions, there is no loop in the trajectories of the 
state diagram of the Lu-Kumar network with two groups of two queues. 

Proof. We prove the lemma by contradiction. To have a loop in the state diagram, 
there are three possible scenarios. 

Scenario I: There is an empty group in one of the states in the loop. 

Without loss of generality, we can consider this state to be (1, 0) or (1, 2, 0). 

To show that this is not possible, we first show that (1,2,0) cannot be feasible. To 
see this, assume that (1,2,0) is feasible. Since a queue cannot disappear from the set 
of maxima by leaving a feasible state, the only possible transitions starting from (1, 0) 
or (1,2,0) are 

(1,0) -> (1,2,0) (0,0) or (1,0) (0,0). 

These transitions lead to the absorbing zero-state, which contradicts the existence of a 
loop. Hence, (1, 2, 0) is not feasible and (1, 0) must be the feasible state with an empty 
group in the loop. 

Second, we claim that (1,2,3,4) cannot be feasible. Assume that it is. One then 
has the following transitions starting from (1,0): 

(l,0)^(l,2,0) o ^(l,2,3,4). 

In (1,2,3,4), the drift of group 2 is positive since it was previously empty so queues 
3 and 4 are necessarily increasing. Thus, group 1 has negative drift and next becomes 
empty. We claim that the next feasible state is then (0,3,4). Indeed, if that state is 
not feasible, the next feasible state would then be (0,3) (without loss of generality). 
But, in that state, the maximum 3 must decrease (since group 1 has a zero drift and 



one of the groups must have a negative drift, by Lemma 3.3) and the other queue 4 



does not, which is not possible. Thus, the next transitions must be 

(1,2,3,4) -> (0,3,4) ->(M), 



which contradicts the existence of a loop. 
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Third, we show that S t must go to the zero state. Indeed, we have the following 
transitions: 

(1,0) -> (l,2,0) o -> (1,2,3,4) . 

The next state is either (1,2,3) or (1,2,4). To see this, first note that if one of 
queues 1 or 2 are removed from the set of maxima, by Lemma |3.4| group 1 has positive 
drift in the next state. On the other hand, since group 2 was previously empty, it 
necessarily has a positive drift in the next state. Since both of the groups cannot have 
a positive drift, this is a contradiction and it follows that 1 and 2 remain in the set of 
maxima, and group 1 has negative drift. Therefore, without loss of generality we can 
consider the next transition to be to (1,2,3), i.e., we have the following transitions: 



(1,0) -> (1, 2, 0) o -> (1,2,3, 4)o -> (1,2,3). 

Next, group 1 becomes empty and St visits (0,3). After some time, queues 3 and 4 
become equal, as 3 has negative drift, so St visits (0,3,4), so that group 2 has positive 



drift by Lemma 3.4 We claim that (0,3,4) must be feasible. Indeed, group 2 has a 
positive drift, so group 1 cannot have a positive drift and queues 1 and 2 cannot appear 



in a new set of maxima by Lemma 3.4 Since (0, 3, 4) is feasible, the next state is the 
zero state, which contradicts the existence of a loop. 

Scenario II: None of the states in the loop has an empty group and there is a state 
of cardinality 3 in the loop. Note that state (1, 2, 3, 4) cannot be in the loop since from 
that state one of the groups becomes empty. In order to have a loop containing a state 
with cardinality 3, we necessarily have a jump happening from a state with 3 maxima, 
since state (1,2,3,4) cannot be in the loop. Without loss of generality suppose that 
this state is S**- 1 - 1 = (1, 2, 3) and queue 4 is the new maximum that appears. 

Case 1: The drift of queue 3 at S^ is positive, so necessarily drifts of 1 and 2 



are equal and negative by Lemma 3.3 Therefore, we can only jump to S^ = (1, 2, 4) 
with drift of 4 positive and drifts of 1 and 2 negative by Lemma |3.4| From this point, 
no new maximum can appear until group 1 goes empty since X4 > X% > and we are 
back to Scenario I. 

Case 2: The drift of queue 3 at S^ 1 ' is negative. To have a jump from this state, St 
can either go to (1,2,4) with X4 > in which we are in the same situation as Case 1. 
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Figure 3: Loop in state diagram of Lu-Kumar network 
The other possibility is that A3 — X4 < 0, and one of the queues 1 or 2 (for example 



queue 2) is removed from the set of maxima. Note that by Lemma 3.4 queues 3 and 
4 remain equal while having negative drift. From this point, no new maximum can 
appear until group 2 goes empty since X\ > X2 > and we are back to Scenario I. 

Scenario III: All of the states in the loop are of cardinality 2. Obviously, not all 
the maxima of a state can change in a jump. So for example from S = (1, 3), there is 
no jump to S — (2,4). Now we consider 3 cases: 

Case 1: There is a loop of length 2. Without loss of generality we can consider the 
loop to be (1,3) — > (1,4) — > (1,3). But at state (1,4), it is not possible that queue 3 
appears again as the new maximum since A4 > A3 > 0. So there is no loop of length 
2 in the state diagram. 

Case 2: There is a loop of length 3. Without loss of generality we can consider the 
loop to be (1,3) (1,4) — > (2,4) — > (1,3). But clearly the last jump in the loop is 
not valid. So there is no loop of length 3. 

Case 3: There is a loop of length 4. Without loss of generality we can consider the 
loop to be (1, 3) — > (1, 4) — > (2, 4) -> (2, 3) — > (1, 3). We cannot rule out this case just 
by inspection like the previous cases. Note that in each of these states the drift of one 
group is positive and the other one negative since there cannot be a jump to a state 



where both of the drifts are negative by Lemma 3.4 A careful observation shows that 
the sign of the drifts of each group should change in every jump. If not, as we can see 
in Figure [3| the last jump (2, 3) — > (1, 3) is not valid by Lemma 3.4 



The last possible case that we have to investigate is the loop with the drifts shown 
in Figure |4j 

The possibility of this loop happening cannot be rejected just by inspection. We 
write the exact conditions leading to each jump which is an inequality, then sum them 
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Figure 4: Loop in the state diagram of Lu-Kumar network 

up and reach a contradiction. The jump (f 1,3 .1) — > (I 1,4 f) implies that state 
S = (1, 3, 4) is not feasible. Indeed solving equation X3 = X4, where 

X 3 = A 3 - jU 3 T 3 + /iiri 3 + n 3 T 3 r 33 + /i 4 (l - T 3 )r43 

Xi = A 4 - /i 4 (l - T 3 ) + //iri4 + M32V34 + /i 4 (l - 13)7-44, 

leads to T 3 < which is not acceptable. So for T 3 = 0, X 3 < X± and the following 
condition is obtained. 



A 4 - ^4 + //iri4 - A 3 - /iiri 3 - ^ 4 r 43 + fi 4 r 4 4 > (11) 
Similarly, for the other 3 jumps we obtain 3 inequalities which are the following. 



A 2 - H2 + M4^42 - Ai - jli 4 r 4 l - ^2^21 + ^2^22 > 
A3 - ^3 + M2^23 - A 4 - /i 2 f 2 4 - M3^34 + ^33 > 
Al - Ml + M3^13 - A 2 - M3^32 - Ml r 'l2 + Ml 7 "!! > 



(12) 
(13) 
(14) 



Adding inequalities (11) to (14 1, we have 



- Ml(l - ni + r 12 + r 13 - n 4 ) - /i 2 (l + r 2 i - r 22 + r 23 - r 24 ) 

- /i 3 (l - r 3 i + r 32 - r 33 + r 34 ) - /i 4 (l + r 4 i - r 42 + r 43 - r 44 ) > 0, 

which is clearly not true so we reach a contradiction and the proof of the lemma is 
complete. 

The immediate result of Lemma |3.5| is that S t will reach the zero state after a finite 
time since St cannot travel around a finite state diagram without making a loop and 
reaching the zero state. 
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Figure 5: Trajectories of fluid in basic Lu-Kumar network 

We show the simulation results for the Lu-Kumar network of Figure [l] in the fluid 
limit. In the simulation, service rates are fi = [3, 1, 1, 1] T , and arrival rate is A = 0.4. 
Initial queue-lengths is X(0) = [40, 30, 20, 10] T . Figure [5] shows the trajectories of the 
fluid in different queues versus time. As we can see, first the queue-lengths in different 
groups become equal. Then group 1 goes empty, and from that point drift of group 2 
is negative until it is empty. 

4. LDQ Scheduling 

4.1. Policy 

In each group, we define a queue to be "dominating" if it cannot feed a longest 
queue in a different group that is larger than itself. Recall that S is the set of maxima 
in the network. For each group j, the dominating set T>j is defined to be 

Vj = {i£ Gj :r ls = Q if X, < X s ,Vs € S} 

The scheduling policy is to serve the longest queue in T>j. If Dj = 0, do not serve 
any queues from group j. As an example, see Figure [6j where queue 3 is the maximum 
with length 30. Since jobs leaving both queues 1 and 2 can be destined to queue 3, 
T>i = so no queues in station 1 is served. As we can see, the policy is not work- 
conserving. The policy is robust to the knowledge of service rates and exact values 
of routing probabilities. The draw-back in comparison with LQ scheduling is that it 
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Figure 6: LDQ is not work-conserving 
needs global knowledge of queue lengths and the topology of the network. 

4.2. Stability proof 

The fluid model equations for this policy is the same as Equation [I] The scheduling 
policy requires that 



E r,(t) = o. 

i£Gj\Sj 



(15) 
(16) 



Note that since the policy is not work-conserving, we have inequality in Equation 



(151 instead of equality for LQ scheduling. 



We prove the stability using the Lyapunov function V(X) = max{Xj}. By the 
policy, no jobs will be scheduled destined to the queue with maximum length in the 
whole network, (not necessarily the maximum in one group) So, if the maximum is 
unique V(X) is clearly negative. We prove that if the maximum is not unique, in a 
regular point the drift of the set of maxima are equal and negative. Let S' be the set 
of maximum- length queues in the network, and \S'\ — L'. A regular point is a value 
of t E [0, oo) at which the function 



/: [0,oo)->R, /(*) = max{X i } 



Ki<K 



is diffcrcntiable. Suppose that V > 1. In a regular point, by Lemma 3.1 the drifts of 
all the queues in S' are equal. Since there is no flow to the sub-network of queues in 5" 



Stability of Lu-Kumar Networks 



17 



coming from other queues, we can only consider this sub-network to analyse the drift 
of the Lyapunov function. Let the corresponding drift matrix and arrival vectors to set 
S' be T)l' and \l>- Suppose that J' groups (J' < J) have queues in S' so S' = Li j =1 Sj. 
Let L'j = \S'j\. In a regular point, the drift of the queues in this sub-network S' are all 
equal to a. 

Lemma 4.1. f(t) — a < 0. 

Proof. Define matrix E^/ X j/ as the following. 

E= [ei,e 2 ,...,ej,], (17) 

where is a column vector of length V . 

ei = [0 V J-i i ,,lL',O r j/ L ,] T (18) 

J 2^k=i lj k i 2^k=j + i^k 

The matrix equation will be 



D' L E 










E T 0j, XJ , 




alj> 




tj>, 



(19) 



where vector tj> — [tj], tj = J^ieS'- ^ — Note that for a work-conserving policy 
tj = lj. A careful observation shows that at least one of the elements of tj is equal 
to 1, if the network topology is acyclic. The reason is that the sub-network certainly 
has a flow that is leaving the sub-network via an "output" queue. Note that if there is 
a cycle in the network, such a queue may not exist. (See Figure [7]) The group which 
contains the "output" queue is work-conserving. 



Solving Equation ( 19 ) using block inverse formula, we have 



aij, = (e^d^e)- 1 (v T r> L ,- T \ L , +t 



(20) 

The vector ^E t Dl~ T Al' +tj/^ is positive in at least one element corresponding 
to the work-conserving group by the stability condition of this sub-network, (which is 
a weaker condition than the stability condition of the whole network) We have already 
proved that E T D^/~ T E is a negative matrix. Now since E T D£/~ T E(alj') is not a 
negative vector, a cannot be non-negative. 
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Figure 7: No output queue in a cycle 




Figure 8: LDQ in a cycle 



Consequently, V(X) is a Lyapunov function and proof of Theorem |2.2| is complete. 

The simulation results show that the network shown in Figure [7] is indeed unstable 
under LDQ scheduling. In this simulation all the service rates are 1, and the arrival 
rate is 0.2. The result is shown in Figure[5J As one can see, first all the queues become 
equal but then do not go to and remain constant in this example. 

The basic intuition behind this fact is the following. Consider the simple case of 
Figure [9| We have one queue in each station so no scheduling is needed. However, 
LDQ serves only one of the queues at a time, and they are virtually in the same group. 
Consequently, LDQ is not throughput optimal if we have a cycle in the network. 
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Figure 9: A simple cycle 

In the end, we see some simulation results for the basic Lu-Kumar network under 
LDQ scheduling. The network topology is acyclic so we expect LDQ to be stable. 
Simulation results shown in Figure [10] verifies this. In this simulation, all the service 
rate are 1, and the arrival rate is 0.4. As one can see, first all the queues become equal 
and then go to together. 




Figure 10: LDQ in basic Lu-Kumar example 
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